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About me 


Associate Engineer at Presidio 

AWS Certified Solutions Architect Associate & 
AWS Certified Developer Associate 

Regular speaker on Apache Kafka, distributed 
systems, and software development best 
practices 

Active open-source contributor 

Passionate about exploring new technologies 
and solving complex problems in the tech 
industry 


What is Kafka? 


Distributed event streaming platform 

Real-time data pipelines, messaging, log aggregation, and 
stream processing 

Consumers, Producers, Log 

Traditional Architecture: 

o Zookeeper 

o Controller 

o Broker 


Traditional Architecture 


What wrong? 


Complexity and Operational Overhead 
Scalability Limitations 

Consistency Challenges 

Separate resource allocation for Zookeeper 
Limited Fault Tolerance 


KRaft(King)'s Entry 


KRaft = Kafka Raft Metadata mode 
Eliminates Zookeeper dependency 

Part of Kafka Improvement Proposal (KIP-500) 
What have changed? 

o Simplified architecture 

o Improved scalability 

o Enhanced performance 

o Easier operations 


Components of KRaft 


e Raft consensus algorithm 
e Controller quorum 
e Metadata as internal topic 


KRaft Architecture 


KRaft vs Zookeeper 


e Key differences: 
o Consensus protocol 
o Metadata storage 
o Scalability 
e Advantages of KRaft: 
o Single system to manage 
o Improved fault tolerance 


o Better performance for metadata operations 


Let's see it in action! 


System Benchmarks 


Latest Progressions 


Kafka Tiered Storage (KIP-405) 

Kafka Streams DSL Improvements 

Enhanced Security: Finer-grained access controls 
Cluster-wide dynamic log adjustment for Kafka Connect 
Queues for Kafka 


Thanks! 


Do you need further clarification on anything? 
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